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MEMORY CHANNEL TEST FIXTURE AND METHOD 



FIELD OF THE INVENTION 

This present invention relates generally to memory systems, components, and 
5 methods, and more particularly to functionality for testing memory module buffers, buffered 
memory channels, and buffered memory modules independent of a host memory controller 
and host memory channel. 

BACKGROUND 

Digital processors, such as microprocessors, use a computer memory subsystem to 
10 store data and processor instructions. Some processors communicate directly with memory, 
and others use a dedicated controller chip, often part of a "chipset," to communicate with 
memory. 

Conventional computer memory subsystems are often implemented using memory 
modules. Referring to Figure 1, a microprocessor 20 communicates with a memory 

15 controller/hub (MCH) 30 that couples the microprocessor 20 to various peripherals. One of 
these peripherals is system memory, shown as memory modules 40, 42, and 44 inserted in 
card slots 50, 52, and 54. When connected, the memory modules are addressed from MCH 
30 whenever MCH 30 asserts appropriate signals on an Address/Control Bus 60. Data 
transfers between MCH 30 and one of memory modules 40, 42, and 44 occur on a Data Bus 

20 70. Address/Control Bus 60 and Data Bus 70 are referred to as "multi-drop" buses due to 
their use of multiple bus stubs for each memory module. 

In this prior art system, MCH 30 initiates all memory transactions, all memory write 
data passes through MCH 30 to the modules, and all memory read data passes through MCH 
30 to reach microprocessor 20 or another peripheral (not shown) performing a direct memory 

25 access. Absent a functioning MCH or a special purpose prototype MCH, it is impossible to 
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evaluate the performance of address/control bus 60, data bus 70, and the memory modules. 
BRIEF DESCRIPTION OF THE DRAWING 
The embodiments may be best understood by reading the disclosure with reference to 
the drawing, wherein: 
5 Figure 1 illustrates a prior art computer memory subsystem; 

Figure 2 shows a memory subsystem according to some embodiments of the present 
invention; 

Figures 3a and 3b illustrate the physical appearance of a fully-buffered Dual Inline 
Memory Module (DIMM) according to some embodiments of the present invention; 
10 Figure 4 shows the internal architecture of a memory module buffer according to 

some embodiments of the present invention; 

Figure 5 schematically depicts two memory module buffers connected in a memory 
channel test configuration according to some embodiments of the present invention; 

Figures 6 and 7 show two test fixture embodiments according to embodiments of the 
15 present invention; and 

Figure 8 shows a test fixture embodiment implemented on an expansion bus- 
compatible computer card. 

DETAILED DESCRIPTION OF THE EMBODIMENTS 
This description describes various test configurations, memory components, and 
20 methods for testing memory modules and memory module buffers independent of a memory 
controller and/or a memory channel to a memory controller. These embodiments are useful 
with what are referred to herein as "buffered memory modules, which have a buffer that 
isolates memory device on the module from a host memory bus." 

Referring to Figure 2, a buffered-memory-module memory subsystem 100 is shown, 
25 comprising a host 110, four buffered memory modules 120, 130, 140, and 150, four memory 
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channels 1 12, 122, 132, and 142, and a low-speed system management bus 160. Host 110 
can include one or more microprocessors, signal processors, memory controllers, graphics 
processors, etc. Typically, a memory controller coordinates access to system memory, and 
the memory controller will be the component of host 1 10 connected directly to the host 
5 memory channel 112. 

Buffered memory module 140 is typical of the memory modules. A memory module 
buffer (MMB) 146 connects module 140 to a host-side memory channel 132 and to a 
downstream memory channel 142. A plurality of memory devices (Dynamic Random Access 
Memory Devices, or "DRAMs" like DRAM 144, are shown) connect to memory module 
10 buffer 146 through a memory device bus (not shown in Figure 2) to provide addressable 
read/write memory for subsystem 100. 

Figures 3a and 3b show one possible physical appearance for DIMM embodiments of 
memory module 140. A set of card edge connectors 148 provide electrical connection for 
host-side and downstream memory channels, reference voltages, clock signals, SMBus 160, 
15 etc. MMB 146 is centrally located on one side of module 140, flanked on each side by four 
DRAM devices 144. Ten more DRAM devices occupy the opposite side of module 140. The 
electrical connections present on the module will be explained below with reference to Figure 
5. 

Each memory channel in Figure 2 is a point-to-point connection between two devices, 
20 either two MMBs or the host and an MMB. The direct connection allows the memory 
channels to run preferably at extremely high data rates, e.g., at speeds that would not be 
possible with a multi-drop bus that has a high capacitive loading and multiple stubs. 

Host 110 accesses the memory space of module 140 by sending a command, 
addressed to memory module 140, out on host memory channel 112. The MMB of buffered 
25 memory module 120 receives the command and resends it on memory channel 122 to the 
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MMB of buffered memory module 130. The MMB of buffered memory module 130 next 
receives the command and resends it on memory channel 132 to MMB 146. MMB 146 
detects that the command is directed to it, decodes it, and transmits DRAM commands and 
signaling to the DRAMs (e.g., 144) controlled by that buffer. When a response is expected 
5 (such as when a read is requested), MMB 146 receives the data from the DRAMs, 

encodes/formats the data, and sends it backwards along the memory channels to host 110. 

In a memory subsystem such as subsystem 100, it has now been found desirable to 
provide for testing and evaluation of individual memory modules and individual module-to- 
module memory channels independent of the host and host memory channel. For instance, it 

10 may be desirable to test MMB performance and features and settle on a buffer design before 
attempting to build a memory controller to work with those MMBs. Further, a memory 
controller or prototype memory controller may not initially work, given the challenging 
signaling problems present in memory subsystems or a prototype buffer may be only partially 
functional. It may be desirable to test memory modules during manufacturing independent of 

15 a particular system implementation. 

To provide a capability for solving these and or similar problems, the MMB 
embodiments, test fixtures, and memory subsystems described herein provide a separate 
reliable channel to allow testing independent of a memory controller and/or host memory 
channel. For instance. Figure 2 illustrates a control bus (SMBus 160) routed to the host 110 

20 and to each of the buffered memory modules 120, 130, 140, and 150. Although proprietary 
or other standard buses or signaling can be used in a particular embodiment, an Smbus is 
illustrated in Figure 2. An SMBus is a particular type of control bus that conforms to the 
System Management Bus (SMBus) Specification^ SBS Implementers Forum, Version 2.0, 
August 3, 2000. SMBus 160 provides a reliable low-speed (10 to 100 kbps) serial channel 

25 that is typically used in a computer to control peripherals such as a battery management 
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system, fans, laptop display settings, etc. 

In Figure 2, SMBus 160 connects to each MMB. Host 1 10 or another device (not 
shown) can use SMBus 160 to issue commands directly to one of the memory modules, 
effectively bypassing host memory channel 112 and any intervening module-to-module 
5 memory channels and memory modules. For instance, SMBus 160 can be used to instruct 
MMB 146 to test its attached memory by issuing a series of reads and writes. If a memory 
buffer supports such operations it may be instructed to issue commands to other DIMMs. For 
example, a buffer might be instructed to initiate a write command over memory channel 142 
to a location on memory module 150, and then initiate a read command to the same memory 

10 location to verify the proper operation of memory channel 142 and/or memory module 150. 
Alternatively a buffer chip may be instructed to issue low level tests of the DIMM to DIMM 
interconnect by sending a stream of data to a target DIMM. The target DIMM may be 
instructed to examine the data stream for errors or return data to the initiating DIMM for 
evaluation. Other test modes are possible depending on the desired nature of the test and the 

15 test methods supported by a given buffer design. Although the data rate available over 

SMBus 160 is a tiny fraction of the memory channel data rate, control circuitry in memory 
module buffer 146 can respond to an SMBus command with full-data-rate memory channel 
transactions. This control circuitry is explained next, with reference to Figure 4. 

Figure 4 shows a block diagram for a memory module buffer 200 according to some 

20 embodiments of the present invention. Memory module buffer 200 maintains a substantial 
number of external connections. Various buffers, flip-flops, receivers, and drivers facilitate 
signaling on these connections, although further description of these circuit elements is 
omitted as not critical to the understanding of the embodiments. 

Several of the functional blocks included in memory module buffer 200 are important 

25 to the embodiments. Each will be described in turn. 
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Data Merge block 210 normally receives data from the host-side memory channel port 
Southbound Data In and repeats that data out on the downstream memory channel port 
Southbound Data Out. Deserializer 212 reads the data passing through block 210, which may 
in fact be directed at buffer 200. An Input/Output Built-in Self Test (lOBIST) southbound 
5 (SB) Data Transmit input to block 210 has the capability to override the normal Southbound 
Data input. This embodiment uses the lOBIST SB Data Transmit output to capture the 
downstream memory channel and perform tests, as will be described below. 

Data Merge block 220 and Deserializer 222 function in the northbound data path 
similar to blocks 210 and 212 in the southbound data path. An lOBIST Northbound (NB) 

10 Data Receive channel allows MMB 200 to receive reply and result messages to lOBIST 
commands transmitted on the Southbound Data Output. 

lOBIST block 230 and SMBus Controller 240 provide a path for initiating commands 
that cause MMB 200 to exercise its downstream memory channel, by injecting commands 
and/or data at block 210 and receiving memory channel responses at blocks 220 and 222. 

15 Test commands that are unavailable from the memory controller are possible. For instance, 
lOBIST 230 can be instructed to perform a write/read pattern test on downstream memory, 
using an internal pattern generator, address counter, and comparator (not shown), and then 
report success/failure back to the SMBus device that requested the pattern test. lOBIST 230 
can be instructed to continually exercise the memory channel until instructed otherwise, 

20 while memory channel waveforms are observed and/or bit error rates are calculated. These 
exemplify the wide range of test conditions that can be designed into lOBIST 230. 

lOBIST 230 can also be commanded from the SMBus to test its host-side memory 
channel. In a host-side memory channel test, for instance, data received at the Southbound 
Data In port is forwarded to lOBIST 230. lOBIST 230 can then perform some commanded 

25 function, such as repeating the data to the NB Data Out port. One possible test is to set a 
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downstream MMB to this host-side memory channel test mode, and then set an upstream 
MMB to a downstream memory channel test mode, allowing the memory channel between 
the two to be verified in a loopback configuration. 

MEMBIST block 260 supplies memory write data to the Data Out path when data is 
5 to be written to the memory devices, and receives memory device read data from the DRAMs 
over the Data In path when data is read from the memory devices. MEMBIST block 260 will 
then compare the returned data to the expected data to determine if there is an error in the 
DRAM or along the connection from the AMB to the DRAM. This test may be initiated from 
the SMBus or fi-om the host-side interface in a manner similar to the initiation of other tests. 

10 Figure 5 shows a general electrical schematic 300 for test configurations employing 

MMBs such as MMB 200 of Figure 4. An MMB 200 is designated as a "Master" MMB 
because its host-side memory channel is unconnected or at least unused during the test. A 
second MMB 310 is designated as a "Normal" or "Slave" MMB because, fi-om its position, it 
is oblivious to the fact that the Master MMB is not connected to any host-side device. Other 

15 MMBs (not shown) can be connected downstream of MMB 310. 

A memory channel is connected between MMB 200 and MMB 310. MMB 200 
southbound (SB) memory channel output port SB Out is connected to MMB 310 southbound 
memory channel input port SB In. MMB 200 northbound (NB) memory channel input port 
NB In is connected to MMB 310 northbound memory channel output port NB Out. 

20 An SMBus connection is also made to each MMB. An SMB Clock input signal is 

routed to an SMB Clk input port on each MMB. A bidirectional serial bus SMB Data is 
routed to an SMB Data I/O port on each MMB. 

A clock generator circuit 320, e.g., capable of supplying a variable-frequency clock 
reference in the 100 to 200 MHz range, connects to a clock buffer 330. Clock buffer 330 

25 creates multiple replicas of the clock reference, one for each MMB, and supplies each to the 
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Ref Clk input of a respective MMB. 

Although optional, Master MMB 200 can be connected to a bank of memory devices 
340a-340i. Two copies of the DRAM Address/Command signals are made to alleviate bus 
loading problems. Copy 1 is distributed to memory devices 340a-340d, and Copy 2 is 
5 distributed to memory devices 340e-340i. A portion of the DRAM Data/Strobe signal bus is 
routed to each memory device. For instance, as shown, DQ0:7 and DSO: 1 (Data bits 0 to 7 
and data strobes 0 and 1) are routed to memory device 340a, DQ8:15 and DS2:3 are routed to 
memory device 340b, etc. Memory device 340e receives eight bits of data, which in normal 
host operation represent ECC (Error Correction Code) data corresponding to the data 
10 supplied on DQ0:63. For test operation, the ECC DRAM can be treated like the other 
DRAMs. 

Normal MMB 310 connects to memory devices 350a-350i in the same manner that 
Master MMB 200 connects to memory devices 340a-340i. 

Once test configuration 300 is connected in the manner shown in Figure 5, the SMBus 

15 connection to Master MMB 200 can be used to initiate tests of: the memory device channel 
to, and memory devices 340a-340i, if included; the memory channel between Master MMB 
200 and Normal MMB 310; once that memory channel is verified, the memory device 
channel to, and memory devices 350a-350i; once the memory channel is verified, additional 
memory channels to additional devices (not shown). Note that with an SMBus connection to 

20 Normal MMB 310, MMB 310 can directly test and report on the connection to its own 
memory devices, and can also be a "master" for testing a memory channel downstream of 
that device. 

An alternative embodiment connects a dedicated chip, module, or high-speed test 
equipment to the southbound input and northbound outputs of MMB 200. Although cost- 
25 prohibitive in many applications, such a chip, module or equipment can be used to simulate a 
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host controller by generating and receiving signals at the full data rate of the link. In this case 
all MMBs on the memory channel may be operated as slave devices. 

Figure 6 illustrates one physical layout for a memory test fixture according to an 
embodiment of the invention, in side view and top view. A circuit board 410 contains at least 
5 one, but preferably a plurality of buffered DIMM electrical connectors 420a-420f (the 

plurality can be any number supported by the overall system design). The circuit board also 
has a connection point for mounting an MMB 430 to circuit board 410 to serve as a Master 
MMB. 

One or more buffered DIMMs under test (DIMMs 440a and 440b shown) are inserted 
10 into the DIMM electrical connectors to make a testable circuit. To test all DIMMs from 

Master MMB 430, the DIMMs should be inserted in the DIMM electrical connectors closest 
to the Master MMB. Master MMB 430 may be connected to DRAM devices on the test card 
or to a prior art DIMM to allow local storage of data (not shown). 

Voltage regulators 450 and/or a clock generator 460 for the DIMMS and MMB 430 
15 can be located on circuit board 410, or operating voltages and clock signals can be generated 
elsewhere and injected into appropriate ports on circuit board 410. Additional functions such 
as circuits to control timing, adjust reference voltages, count events, establish environmental 
conditions, or create other conditions of interest may be placed on the test fixture, connected 
to the test fixture, or otherwise placed in such a way as to allow control of the desired 
20 conditions. 

Electrical traces are patterned on and/or in circuit board 410 to correspond to memory 
channels, a control bus, and the clock signal paths shown in Figure 5. For instance, one set of 
traces link the connection point for the Master MMB 430 with DIMM electrical connector 
420a to form a point-to-point memory channel 432 when MMB 430 is attached and a DIMM 
25 is inserted in electrical connector 420a. A second set of traces link other portions of DIMM 
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electrical connector 420a with DIMM electrical connector 420b to form a point-to-point 
memory channel 434 when DIMMs are inserted in electrical connectors 420a and 420b. 

Control bus traces 470, e.g., for an SMBus, are routed at least to the connection point 
for Master MMB 430. Preferably, this bus also connects to DIMM electrical connectors 
5 420a-420f, as shown, so that SMBus control of DIMMs inserted in those connectors can also 
be achieved. 

Test fixture 400 can be connected directly to a computer, test equipment, etc. to 
perform memory module and memory channel testing without a host memory controller in 
the test loop. 

10 Figure 7 shows an alternate layout for a test fixture 500 according to another 

embodiment of the invention, with a circuit board 510, DIMM electrical connectors 520a- 
520f, memory channel traces for memory channels (e.g., 534 and 536) between adjacent 
DIMM electrical connectors, and a control bus 570 connected to each DIMM electrical 
connector. Instead of mounting a Master MMB directly to a circuit board as shown in Figure 

15 6, the Master MMB in Figure 7 is the buffer located on the module inserted in first occupied 
electrical connector slot, and thus the connection point for the Master MMB is that first 
occupied slot. 

Three DIMMs 540a, 580, and 540c are shown inserted respectively in electrical 
connectors 520a, 520b, and 520c of test fixture 500. DIMM 580 is an optional test DIMM 

20 with a take-off point 582 for memory device channel traces. Take-off point 582 can be 
connected to lab equipment to observe memory transactions taking place on the memory 
device channel of memory module 580. To simplify the creation of such a take-off point, 
memory devices are not mounted on module 580. The buffer on test DIMM 580 will 
normally be incorporated into the memory channel as would any other DIMM. As with a 

25 normal DIMM, the southbound output port and northbound input port of the buffer on test 
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DIMM 580 will normally be routed back to electrical connector 520b to complete the circuit 

to DIMMs in connectors 520c and beyond. 

Since test DIMM 580 occupies an electrical connector such as 520b, it is desirable to 

place an additional electrical connector 584 on the test DIMM to allow a DIMM that would 
5 have otherwise been inserted in connector 520b to be placed in the memory channel. In this 

way the test fixture does not lose a possible DIMM connection point. 

Yet another test fixture embodiment 600 is illustrated in Figure 8, with a circuit board 

610, DIMM electrical connectors 620a-620d, a Master FBD buffer 630, memory channel 

traces 632, 634, etc., voltage control circuitry 650, a reference clock generator 660, and a 
10 control bus 670, all of which can be configured as their counterparts shown in Figure 6. 

Circuit board 610 has a card-edge connector 612 for a PCI (Peripheral Component 

Interconnect) Bus, which is a well-known expansion bus found on many IBM-compatible 

personal computers. An optional PCI Bus Interface circuit 614 can be used to pass control 

signaling to a Master MMB 630 mounted on circuit board 610 over control bus 670. If an 
15 SMBus is used for control bus 670, connection can be made directly to a personal computer 

SMBus through card-edge connector 612. 

When connected to a personal computer, the personal computer can pass test 

commands to MMB 630, or another memory buffer on an inserted buffered DIMM, through 

control bus 670. If the optional PCI Bus Interface circuit 614 is used, the test commands can 
20 be styled as PCI transactions initiated by the personal computer host processor. If connection 

is made directly to the personal computer SMBus, the host processor can initiate SMBus 

transactions to pass test commands to a memory buffer. 

In many motherboard implementations, SMBus signals are available on one or more 

PCI bus interface connectors. This provides a convenient method to insert a circuit board 
25 such as 610. Alternatively, an interface card may be placed in an SMBus-enabled PCI slot. 
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The SMBus or other desired signals may be routed from the interface card to a test fixture 
such as those in figures 6 or 7. With such a configuration, software can be loaded onto the 
personal computer to cause the processor to transmit appropriate commands over the 
appropriate bus, thereby causing a buffered memory module to exercise a memory channel 
5 between two memory modules, and possible memory on one or the other of the modules. 
The processor can receive results back over the control bus, which can be interpreted by 
software. Such software can be used to perform manual memory channel experiments and/or 
automated testing of buffered DIMM circuitry and devices. If supported by the test fixtures or 
interface cards a higher speed bus such as a proprietary bus or a standard bus such as USB 

10 may be used to communicate information to or from the DIMMs under test. This is usefiil if 
the test sequence requires or generates large amounts of data. 

One of ordinary skill in the art will recognize that the concepts taught herein can be 
tailored to a particular application in many other advantageous ways. In particular, those 
skilled in the art will recognize that the illustrated embodiments are but one of many 

15 alternative implementations that will become apparent upon reading this disclosure. For 
instance, a wide variety of memory tests may be envisioned using the concepts disclosed 
herein, only a few of which are discussed specifically herein. The particular test sequence or 
sequences initiated using an embodiment is important from a testing viewpoint, but all such 
tests can be performed within the scope of the appended claims. 

20 Many of the specific features shown herein are design choices. Channel and bus 

widths, signaling frequencies, DIMM layouts, number of memory devices, control bus 
protocols, etc., are all merely presented as examples. DIMMs can have multiple ranks of 
memory and/or memory modules stacks of multiple devices. Likewise, functionality shown 
embodied in a single integrated circuit or functional block may be implemented using 

25 multiple cooperating circuits or blocks, or vice versa. Such minor modifications are 
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encompassed within the embodiments of the invention, and are intended to fall within the 
scope of the claims. 

The preceding embodiments are exemplary. Although the specification may refer to 
"an", "one", "another", or "some" embodiment(s) in several locations, this does not 
5 necessarily mean that each such reference is to the same embodiment(s), or that the feature 
only applies to a single embodiment. 
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